[SPARK-10620] [SPARK-13054] Minor addendum to #10835#10958
[SPARK-10620] [SPARK-13054] Minor addendum to #10835#10958andrewor14 wants to merge 8 commits intoapache:masterfrom
Conversation
…-accums-followups Conflicts: core/src/main/scala/org/apache/spark/Accumulable.scala
andrewor14
force-pushed
the
task-metrics-to-accums-followups
branch
from
7e953f2 to
5a24601
Compare
andrewor14
force-pushed
the
task-metrics-to-accums-followups
branch
from
5a24601 to
822899d
Compare
|
Test build #50234 has finished for PR 10958 at commit
|
With this change, we ALWAYS post task end events in canceled stages for both tasks that succeeded and tasks that failed.
andrewor14
changed the title
|
Test build #50235 has finished for PR 10958 at commit
|
|
Test build #50238 has started for PR 10958 at commit |
|
retest this please |
|
Test build #50244 has finished for PR 10958 at commit
|
There was a problem hiding this comment.
(comment for linking)
There was a problem hiding this comment.
This should probably have a test like #10951. We should combine our efforts on this. This might make more sense to have in a separate PR from the other style things but doesn't matter to much.
There was a problem hiding this comment.
ok, I separated it
There was a problem hiding this comment.
are you going to file a separate pr or should I just update mine ?
There was a problem hiding this comment.
you can just update yours
| class Accumulator[T] private[spark] ( | ||
| @transient private[spark] val initialValue: T, | ||
| // SI-8813: This must explicitly be a private val, or else scala 2.11 doesn't compile | ||
| @transient private val initialValue: T, |
There was a problem hiding this comment.
This change was already added in another patch, causing a merge conflict here.
|
LGTM. Sorry for the delay in reviewing. |
This reverts commit ba5f555.
…-accums-followups Conflicts: core/src/test/scala/org/apache/spark/InternalAccumulatorSuite.scala
|
Test build #50943 has finished for PR 10958 at commit
|
|
I'm going to merge this into master. Thanks! |
4 participants
Additional changes to #10835, mainly related to style and visibility. This patch also adds back a few deprecated methods for backward compatibility.